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PATENT 

Microsoft Matter No.: 305898.01 
Attorney Docket No.: MCS-082-03 

IN THE UNITED STATES PATENT AND TRADEMARK OFFICE 

In re the Application of: MALVAR et al. 

Serial No.: 10/801,450 Group Art Unit: 2624 

Filed: March 15,2004 Examiner: C. M. LAROSE 

For: HIGH-QUALITY GRADIENT-CORRECTED LINEAR 

INTERPOLATION FOR DEMOSAICING OF COLOR IMAGES 



PROPOSED AMENDMENTS IN RESPONSE 
TO EXAMINER-INITIATED INTERVIEW 

Hon. Commissioner for Patents 

P.O. Box 1450 

Alexandria, VA 22313-1450 

TC2600 

Facsimile No.: (571)273-8300 



Dear Examiner Le: 

As we discussed, please find attached proposed amendments to the claims. 
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IN THE CLAIMS 

Please amend claims 1 , 9, 22, 23, 28, and 37 as follows: 

1 . (Currently Amended) A method for interpolating a desired color at a current 
pixel in a color image, the current pixel having a current color, comprising: 

using a computer to perform the following process actions: 

computing an interpolation of the desired color at the current pixel 
using the desired color; 

computing a gradient correction term using the current color; 

determining a gradient-correction gain such that a mean-square error 
is minimized to produce an optimal gradient-correction gain; 

applying the optimal gradient-correction gain to the gradient 
correction term to determine an amount of the gradient correction linearly combined with 
the interpolation; and 

linearly combining the interpolation and the gradient correction term 
to obtain a corrected interpolation of the desired color at the current pixel. 

2. (Original) The method as set forth in claim 1 , further comprising using 
neighboring pixels of the desired color in computing the interpolation. 

3. (Original) The method as set forth in claim 1 , further comprising using the 
current pixel in computing the correction term. 

4. (Original) The method as set forth in claim 3, further comprising using 
neighboring pixels of the current color in computing the correction term. 



5. (Original) The method as set forth in claim 1 , wherein the interpolation is a 
bilinear interpolation technique. 

6. (Canceled) 
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7. (Canceled) 

8. (Original) The method as set forth in claim 1 , further comprising adding the 
interpolation and the correction term to obtain a corrected interpolation. 

9. (Currently Amended) A computer-implemented method for interpolating a 
desired color at a current pixel in an image sensor, the current pixel having a first color, 
comprising: 

using a computer to perform the following process actions: 

computing a first interpolation of the desired color at the current pixel 
using pixels having the desired color; 

computing a gradient correction using pixels having the first color; 

linearly combining the first interpolation and the gradient correction to 
obtain a gradient-corrected interpolation of the desired color at the current pixel; 

applying a gradient-correction gain to the gradient correction to affect 
the amount of the gradient correction that is linearly combined with the first interpolation; 
and 

selecting the gradient-correction gain such that a mean-square error 
is minimized to produce an optimal gradient-correction gain. 

10. (Canceled) 

11. (Canceled) 

12. (Previously Presented) The computer-implemented method of claim 9, 
further comprising adjusting the optimal gradient-correction gain to produce a simplified 
gradient-correction gain that allows computations using at least one of: (a) integer 
arithmetic; (b) no division operations. 

1 3. (Original) The computer-implemented method of claim 9, wherein the first 
interpolation is a linear interpolation. 
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14. (Original) The computer-implemented method of claim 1 3, wherein the linear 
interpolation is a bilinear interpolation. 

1 5. (Original) The computer-implemented method of claim 9, wherein the first 
interpolation is at least one of: (a) a bilinear interpolation; (b) a bi-cubic interpolation; (c) 
a Lanczos interpolation. 

1 6. (Original) The computer-implemented method of claim 9, further comprising: 
defining a region of support as a size of a pixel neighborhood whose values 

are considered for computation associated with any given pixel; 

selecting the region of support to include pixels nearest the current pixel 
having the first color; and 

using the region of support to compute the first interpolation and the gradient 

correction. 

17. (Original) The computer-implemented method of claim 1 6, wherein the 
region of support is a 5x5 pixel region centered at the current pixel. 

1 8. (Original) The computer-implemented method of claim 16, wherein the 
region of support is greater than a 5x5 pixel region centered at the current pixel. 

1 9. (Original) The computer-implemented method of claim 1 8, wherein the first 
interpolation is a nonlinear interpolation. 

20. (Original) The computer-implemented method of claim 16, further 
comprising: 

using a first region of support to compute the first interpolation; and 
using a second region of support to compute the gradient correction. 
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21 . (Original) The computer-implemented method of claim 20, wherein the first 
region of support is different from the second region of support. 



22. (Currently Amended) A computer-readable medium having stored and 
encoded thereon computer-executable instructions for performing on a oomput i ng dev i ce 
the computer the computer-implemented method recited in claim 9. 

23. (Currently Amended) A method for interpolating missing red-blue-green 
(RGB) data at a current pixel having a current color in a color image sensor, comprising: 

using a computer to perform the following process actions: 

using a first interpolation technique based on a missing color at the 
current pixel to determine a missing color estimate; 

calculating a gradient correction based on the current color; 
adjusting a gradient-correction gain based on characteristics of the 

color image sensor; 

multiplying the gradient correction by the gradient-correction gain to 
obtain an adjusted gradient correction; and 

combining in a linear manner the missing color estimate and the 
adjusted gradient correction to obtain a linearly corrected missing color estimate 
corresponding to at least some of the missing RGB data. 

24. (Original) The method of claim 23, wherein the first interpolation technique 
is a bilinear interpolation. 

25. (Original) The method of claim 23, wherein the gradient correction is a 
linear operator. 

26. (Canceled) 
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27. (Previously Presented) The method of claim 23, wherein the color image 
sensor is integrated into a digital camera system, and further comprising adjusting the 
gradient-correction gain based on characteristics of the digital camera system. 

28. (Currently Amended) A process for linearly interpolating a missing color of a 
present pixel within a color image produced by a digital camera system having an image 
sensor, the present pixel having a first color, the process comprising: 

using a computer to perform the following process actions: 

defining a first region of support centered at the present pixel; 

interpolating the missing color using an interpolation technique to 
obtain a first missing color estimation, the interpolation technique using pixels within the 
first region of support having the missing color; 

defining a second region of support centered at the present pixel; 

calculating a gradient correction using the present pixel and pixels 
within the second region of support having the first color; 

applying a gradient-correction gain to the gradient correction that 
represents a percentage of the gradient correction to be used; 

measuring global statistics of the color image; 

varying the gradient-correction gain based on the global statistics; 

and 

linearly combining the first missing color estimation and the gradient 
correction to obtain a gradient-corrected estimation of the missing color. 

29. (Canceled) 

30. (Canceled) 

31 . (Previously Presented) The process as set forth in claim 28, further 
comprising: 

measuring local statistics for each region in the color image; and 
varying the gradient-correction gain based on the local statistics. 
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32. (Original) The process as set forth in claim 28, further comprising 
computing the gradient-correction gain based on the missing color. 

33. (Original) The process as set forth in claim 32, wherein the missing color 
is green, and further comprising setting the gradient-correction gain to a value of !4. 

34. (Original) The process as set forth in claim 32, wherein the missing color is 
red, and further comprising setting the gradient-correction gain to a value of 5/8. 

35. (Original) The process as set forth in claim 32, wherein the missing color is 
blue, and further comprising setting the gradient-correction gain to a value of 3/4. 

36. (Original) The process as set forth in claim 28, wherein the first and second 
regions of support are a 5x5 matrix of pixels. 

37. (Currently Amended) A gradient-corrected linear interpolation system for 
interpolating a missing color value at a given pixel in a color image, the given pixel having 
a current color, comprising: 

a general-purpose comput i ng d e vic e computer : 

a computer-readable storage medium having stored and encoded thereon a 
computer program having program modules containing computer-executable instructions 
that are executable by the general-purpose comp ut i ng d e v i c e computer , the computer 
program further comprising: 

an interpolation module that computes an interpolation of the missing 

color value; 

a correction term computation module that computes a gradient 
correction term for the interpolation, the correction term computation module further 
comprising: 

a gradient-correction selector that determines a gradient-correction 
gain such that a mean-square error is minimized to produce an optimal gradient-correction 
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gain and applies the optimal gradient-correction gain to the gradient correction term to 
determine an amount of gradient correction linearly combined with the interpolation; and 
a linear combination module that linearly combines the interpolation and 
correction term to produce a corrected interpolation for the missing color value at the given 
pixel. 

38. (Original) The gradient-corrected linear interpolation system as set forth in 
claim 37, wherein the correction term computation module further comprises a region of 
support module that selects a size of a region of support around the given pixel 
centered at the given pixel. 

39. (Canceled) 

40. (Original) The gradient-corrected linear interpolation system as set forth in 
claim 37, wherein the correction term computation module further comprises a gradient 
correction module that computes a gradient correction using the given pixel and pixels in a 
region of support having the current color. 
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REMARKS 



The above proposed claim amendments to claims 1 , 9, 22, 23, 28, and 37 are 
intended to place pending claims 1-5, 8, 9, 12-25, 27, 28, 31-38, and 40 in condition for 
allowance. These proposed claim amendments are in response to an interview that 
occurred between Examiner Brian Q. Le and the Applicants' attorney, Craig S. Fischer, on 
November 17, 2008. 

The Applicants kindly invite the Examiner to telephone the Applicants' attorney at 
(805) 278-8855 if the Examiner has any comments, questions or concerns, wishes to 
discuss any aspect of the prosecution of this application, or desires any degree of 
clarification of these proposed claim amendments. 



LYON & HARR, LLP. 

300 East Esplanade Drive, Suite 800 

Oxnard, CA 93036-1274 

Tel: (805)278-8855 

Fax: (805)278-8064 




Respectfully submitted, 
Dated: November 17, 2008 
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